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The increased focus on the preparation of pre-service teachers for 
teaching in an ever-changing world impacts how teacher education 
programs both prepare and assess pre-service teachers (National Com- 
mission on Teaching and America's Future, 1996). The most recent 
impetus for this focus began with a general call for reform of public 
schools that ultimately demanded high standards and demonstration of 
performance by both teachers and their students (Carnegie Forum on 
Education and the Economy, 1986; Darling-Flammond, 1986; Goodlad, 
1990, 1994; Flolmes Group, 1986). Teacher education programs had to 
change from a model of paper and pencil evaluation toone in which the 
teacher is responsible for demonstrating his or her own knowledge and 
skills in actual teaching situations (Shul man, 1987). Portfolios provide 
one means of monitoring, documenting and assessing both the pre- 
service teacher and the teacher education program. 

Therealityofdevelopingaportfolioprocessthat has meaningtopre- 
service teachers and that incorporates a conceptual framework and 
rel ated standards is a chal lenge confronti ng educators today. N everthe- 
less, the use of portfolios for assessment coordinates with the new 
National Council for Accreditation of Teacher Education’s (NCATE) 
standardsthat assess pre-service teacher performancepriortoentry into 
the profession (NCATE, 2000). Furthermore, developing portfolios pro- 


Cheryl Stolle Betty Goerss, and Marilyn Watkins are professors in the 
Division of Education at I ndiana University East, Richmond, I ndiana. 


Volume 14, Number 2, Fall 2005 


26 


Implementing Portfolios in a Teacher Education Program 


videstheopportunityfor pre-service and in-serviceteachers to reflect on 
their own learning and communicate who they are as teachers. "Ulti- 
mately, the portfolio as a process demanding at its best constant 
refl ection on teachi ng and learni ng hoi dsthepromise— however fragile— 
of forcing a broader reflection on the ways teachers are educated and 
continue in their professional development" (Lyon, 1998, p. 4). 

Finally, the portfolio as a means of teacher assessment aligns with 
the movement toward more authentic assessment in education. Perfor- 
mance-based assessment involves tasks closely related tothose found in 
the real world, which demonstrate proficiency for a given topic (Wiggi ns 
& McTighe, 1998). It is a type of alternative assessment that asks 
students todemonstrate what they have learned, how they engage in the 
learning process and how they apply their knowledge demonstrating 
their preparedness for teaching (Viechnicki, Barbour, Shaklee, Rohrer, 
& Ambrose, 1993). 'What has emerged is assessment that isauthenticin 
nature, offers multiple indicators of student progress, encourages stu- 
dents to take an active role in their learning, affords teachers new roles 
intheassessment process, andencouragesstudentstodemonstratewhat 
they know in ways that encompass their personal learning styles" 
(McLaughlin & Vogt, 1996, p. 9). As highly individual ized expressions of 
the teacher they represent, portfolios exemplify authentic assessment. 
They provide a means to describe current understanding of teaching 
abi I ities i n a way that is not evi dent i n other formats (Campbel I , Gignetti , 
Melenyzer, Nettles, & Wyman, 2001). While portfolios represent only 
one aspect of documenting teacher effectiveness, they are important 
toolsfor assessing preparedness for teaching. 

Six years ago, the Division of Education at I ndiana University East 
began the process of developinga performance- based program consistent 
with our division's conceptual framework, the I nterstate New Teacher 
Assessment and Support Consortium (I NTASC) principles, and I ndiana 
state standards. This decision coincided with the state mandate for 
teacher education programs to be performance-based, a practicethat is 
becomi ng i ncreasi ngly widespread across thecountry. Onecomponent of 
the state mandate is that all teachers must prepare an INTASC-based 
i nducti on portfol i oto recei ve I i censureat t heend of a two-year probati on- 
ary teaching period. I NTASC identifies a set often princi plesthatteacher 
candidates must demonstrate before they are licensed. 

Developing, implementing, and assessing the portfolio process has 
been and conti nuestobeadauntingtask. There is noblueprint and, while 
wedid extensive preparatory research, we did not understand the depth 
and complexity of issues to be confronted. With that acknowledgement, 
the purpose of this paper istodiscussareasthat must be addressed prior 
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to portfolio implementation and provide our response to each. Table 1 
displays our inquiry questions for each of the six areas. In the sections 
thatfollowwesharewhat welearned, benefits to be gained, and what we 
see as critical issues in portfolio implementation. 

Table 1 : Six Areas of I nquiry 
Responsibility: 

Who is primarily responsible for researching and presenting ideas to the 
division of education as a whole? 

What is the decision making process? 

Purpose: 

What is the rationale for implementing portfolios? 

What i s the benefit of portfol i os to pre-service teachers? 

Placement: 

Where do portfol i os 'f it' i n the program? 

What arethe portfolio requirements: e.g„ content, artifacts, organization, 
explanation and reflection? 

At what point do pre-service teachers havethe necessary depth of content 
and experi ence to compl ete a portfol i o? 

Preparation: 

When are portfolios introduced to students? 

How are students prepared to meet portfolio requirements? 

Assessment: 

On what criteria/standards will portfolios be assessed? 

Who will assess portfolios? 

How will inter-rater reliability be assured? 

How can thedivision of education document and use data from portfolios 
for pre-service teachers and for programmatic improvement? 

Policies: 

What policies and appeals process support the portfolio? 

What types of remediation are availableto pre-service teachers? 


Six Areas of Inquiry 


Responsibility 

Our division of education's organizational structure includes a vari- 
ety of committees. Hence, itfell totheAssessmentCommitteetoconduct 
research on performance-based assessment, develop drafts, facilitate 
divisional discussions and revise drafts as needed. They also developed 
the portfolio guidelines. I nitial preparation of the guidelines by commit- 
tee structure all owed for efficiency; however, final decision-making had 
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to be inclusive to maximize effective implementation. While time con- 
suming, a di vi si on consensus process made i t possi bl efor di vergent vi ews 
to be heard, discussed and resolved. Consensus i mproved understandi ng 
and facu Ity acceptance of portfol i os as a means of assessi ng the perfor- 
mance of pre-service teachers. 

Purpose 

Our rationale for implementing portfolios stemmed, in part, from a 
need to "offer a coherent program of studies that will prepare effective 
teachers rather than a col lecti on of courses based on what professors prefer 
toteach" (National Commission onTeachingandAmerica'sFuture, 1996, 
p. 71). Wesharethe belief that pre-service teachers need a cohesive view 
ofteachingand learning and a theory about learning to teach which gives 
direction to the practical activities of teacher preparation. 

Reflection is perhaps the greatest benefit of the portfolio process for 
in-serviceteachers.Thosededicatedtoteacher reform identify successful 
teachers asthose whoconti nuously reflect critical ly about thei r teachi ng 
and adjust classroom practice accordingly (Moss, 1997). Novice teachers 
from several studies, interviewed after they were in practice, notedthat 
reflection was the most valuable part of the portfolio process (F reidus, 
1996; LaBoskey, 1994, 1996; Lyons, 1996, 1997). Nearly all theteachers 
inthesestudiesfound the portfolio process challenging, yet recognized it 
as a "significant reflective learning experience" (Lyons, 1998, p. 255). 

A second benefit of portfolios is the opportunity for pre-service 
teachers todocument growth or "author their own learning and profes- 
sional development" (Lyons, 1998, p. 250). They may select artifactsthat 
demonstrate their learning closely tied to actual teaching— such as 
lesson plans, assessment of student work, and evaluations by classroom 
and university supervisors (McLaughlin & Vogt, 1996). The portfolio 
process hel psthem learn toidentify, analyzeand apply pri nci pies, content 
and dispositions that will be needed to accurately and convincingly 
document their competency as a teacher for independent practice and 
initial licensure. This issue is quickly becoming high stakes in many 
states, given new licensure expectations and procedures. 

Furthermore, the portfolio may serve pre-service teachers in a 
variety of ways after completion of their pre-service experience (Ambach, 
1996; McLaughlin & Vogt, 1996; Paulson, Paulson & Meyer, 1991; Vogt, 
1994; Wolf & Dietz, 1998). One benefit is during the job search for a 
teaching position. Beginning teachers report their portfolio provides an 
edge by drawing attention totheir candidacy during thejob search even 
when interviewers did not review the portfol io(J onson & Hodges, 1998; 
Winsor & Ellefson, 1995). An equally important benefit of pre-service 
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teacher portfolios is that they help teachers understand the process so 
they can better implement this form of assessment in their own class- 
rooms (Stroble, 1992). 

Placement 

The Assessment Committee, charged with leadership in the transi- 
tion to a performance- based program, determined that there would be 
three programmatic decision points: admission to teacher education, 
admissi on tostudent teachi ng, and graduation . Responsi bi I i ty for thefi rst 
deci si on poi nt was gi ven to the Admi ssi ons Commi ttee. The Assessment 
Committee retained charge of the remaining two. The committee 
determi ned that a portfolio based on theDi vision of Education conceptual 
framework and I NTASC principles would be required for admission to 
student teaching and again for graduation. The same rubric would be 
used for both portfolios; however, thegraduation portfolio would require 
more documentation and higher expectations based on practical applica- 
tion during student teaching. 

The Assessment Committee began the lengthy process of aligning 
I NTASC principles with our conceptual framework as the basis for pre- 
service evaluation. Faculty discussed with pre-service teachers and 
cooperating teachers possible documentation that would demonstrate 
competency for each pri nci pie. An extensive I ist was developed i ncl udi ng 
such items as video-taped lessons, lesson plans, thematic units, tran- 
script, and student work. J ust before the Assessment Committee pre- 
pared to present thei r pi an for portfol i os tothe D i vi si on of E ducati on, two 
members of the committee attended different conferences related to 
portfolios. They returned and in a hallway discussion discovered that 
each hadcometothesameconclusion— pre-serviceteachersshould have 
choice for the portfolio, the opportunity to demonstrate "Who I am as a 
Teacher." The faculty decided the portfolio should contain one video- 
taped lesson, an accompanying lesson plan, and a reflection on the lesson. 
The only other requirement was that pre-service teachers choose 
adequate and appropriate documentation to demonstrate their perfor- 
mance on I NTASC pri nci pies and the Division's conceptual framework. 
This decision aligned with the need for pre-service teachers to make 
meaningful connections and decisions relative to who they are as 
teachers and supports the goal of reflective scholarship. 

It is important that portfolios be connected with a program compo- 
nent to ensure that pre-service teachers are ready to continue in the 
program. At theelementary level the pre-student teachi ng portfol io is a 
part of the field experience associated with an Integrated Reading and 
Social StudiesMethodscourseofferedjustpriortostudentteaching.This 
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aligns well with our secondary program wherethe pre-student teaching 
experience is co-requisite with the reading and specialized methods 
courses. Linking the portfolio to the pre-student teaching field experi- 
ence provides greater continuity of instruction. Pre-service teachers at 
both programmaticlevelsaresimilarlyinstructedenablingthemtomake 
appropriate connections between standards and relevant experiences. 

The graduation portfolio grade continues to be a component of the 
capstone taken concurrently with student teaching. The rationale for 
keepi ng the grade separate from student teachi ng i s that i t i s possi ble for 
a pre-service teacher to pass student teaching yet need to repeat the 
capstoneshould he/shefail theportfolio. I fa pre-serviceteacherfailseither 
pre-student teaching or graduation portfolio, there is one opportunity for 
resubmission. If hefehe fails the resubmission as well, the guidelines 
indicate that the person is removed from the teacher education program. 
H e/she may fol low the appeals process al ready in place at the university. 

Preparation 

As part of the transition to a performance-based program, I NTASC 
principles, state standards, the Division of Education conceptual frame- 
wor k , a n d portfol i o expect at i on s h ad to be effect i vel y i ntegr ated t h r ou gh - 
out our program. Each of these components is introduced in early 
education courses with appropriatediscussion. Beginning with founda- 
tion cou rses, pre-servi ce teachers begi n to devel op art i facts and focus on 
initial reflection. Pre-service teachers begin self-evaluation using the 
I NTASC princi pies, division themes and appraisal of professional perfor- 
mance in their first field experience, and continue doing so through 
student teaching. 

Whilethis is a start, the two year portfolio pilot indicated that pre- 
service teachers needed even more guidance. Hence, we determined a 
system whereby practice with portfolio expectations is gradually intro- 
duced. Pre-service teachers review portfolio guidelines and have an 
opportunitytopracticeexplanationsand reflections in their first methods 
course. During Integrated Methods, the last methods course prior to 
student teaching, portfolio information is discussed throughout the 
semester and at a much deeper level. Early in the semester, I NTASC 
principles are revisited, related to application in the classroom and 
restated in more meaningful terms. Figure 1 provides a timeline 
indicating the sequence of instruction and portfolio implementation. 

The next step taken during the Integrated Methods course is 
brainstorming possible documentation for each principle and division 
theme. Sample portfolios are examined and pre-service teachers are 
guided to consider their artifacts from other courses and from their on- 
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Figurel. 

Ti mel i ne indicating thesequence of the pre-service teacher preparation. 

IUE 

EDUCATION DIVISION elem: reading ii, social 


STUDIES, SEC: CONTENT, PASS or FAIL 

ADMISSION TO READING, ALL PRE STUDENT RESUBMIT, REMEDIAL 

TEACHER ED TEACHING PORTFOLIO PLAN Submitted To State 



Foundation Admission Methods Courses Pre Student Teaching Student Teaching Graduation Port Certification Professional Portfolio 



FOUNDATION ELEM: LA, READING I, CAPSTONE 2 Year Internship 

COURSES MATH, SCIENCE, With Mentor 

SECONDARY: GENERAL 


goingfi eld experience. This activity hel psthemtounderstand application 
of I NTASC principles and themes in their teaching and to begin identifi- 
cation of appropriate artifacts. 

The portfolio is not formally revisited until the field experience is 
completed, two weeks prior to the end of the semester. A cl ass session is 
then devoted to instruction and practice in writing explanations and 
reflectionsthat make connect ions between standards and artifacts. The 
instructor models how to write an explanation and reflection using an 
artifact that pre-service teachers might include, such as a lesson plan. 
This is foil owed by examination of sample explanations and reflections 
based on the model. Then each pre-serviceteacher writes an explanation 
and reflection for a piece of documentation he or she has chosen to use 
in the portfolio. The instructor provides individual feedback so pre- 
servi ceteachers have at least onewell-written explanation and reflection 
that can be used in the portfolio. 

Duringthesame cl ass session, pre-servi ceteachers examinesample 
portfolios. Thefocus is on selecting documentation, on different organi- 
zational formats, and on quality explanations and reflections. 

On the day portfolios are submitted for evaluation, each pre-student 
teacher bri ngsthe portfol iotoshare with cl assmates. Duri ng the i nformal 
presentation of each portfolio, pre-service teachers may ask each other 
questions about organization, choice of artifacts, or related questions. 
Then classmates share positive comments about each portfolio. 

Duri ng the capstone sessions additional guidance is provided for the 
graduation portfolio. The focus of this portfolio is to demonstrate 
competencein I NTASC principlesanddivisionthemeswhilepreparinga 
document that will be appropriate when interviewing for teaching 
positions. Student teachers prepare and present a 10-minute informal 
presentation of their portfolio to their peers. This presentation has 
limited requirements including an explanation of its organization and 
citing of specific examples for how a principle was met. The student 
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teacher receives feedback from peer reviewers based on his/her own 
questions. Peer review is a valued source of feedback and a professional 
habit worth cultivating in pre-service teachers (Lyons, 1998). Following 
this presentation pre-service teachers have the opportunity to improve 
the portfolio before submission, therefore retaining responsibility and 
opportunity to make their professional case. 

Division faculty are available for portfolio consultation prior to 
submission. Every pre-service teacher preparing the pre-student teach- 
ing portfolio meets with one of the instructors for the I ntegrated Course 
for one-half hour. For thegraduation portfolio, pre-service teachers meet 
with one of three faculty members who supervise student teachers and 
havetheoptionof meeting with others. I ndividual consultations provide 
the student with the opportunity to seek clarification or advice from 
trai ned portfol io assessors across the breadth of faculty expertise. This 
avenue provides supplemental guidance in a less public, more individu- 
alized manner. It also provides students with additional information to 
help them analyze their personal assessment of the portfolio and 
comments from the peer review of the portfolio. 

Guidelines containing suggestions for organization, artifact selec- 
tion, and layout were developed to help pre-service teachers through the 
portfolio process. They have several appendices including the I NTASC 
principles, the Division conceptual framework, the rubrics, and some 
sample excerpts from outstanding portfolios. Particularly important to 
pre-servi ce teachers i s one appendi x wi th exampl es of expl anat i ons and 
reflections. These guidelines can be found on our web page (www.iue. 
indiana.edu/departments/doe/ ; click assessment). 

There are still many portfolios that have to be resubmitted due to 
poor selection of documentation or fai lure to write substantive explana- 
tions and reflecti veentries. Frequently, poorwritingskillsarepartofthe 
problem. Table 2 indicates the numbers of pre-service teachers who 
passed the portfolio, who were required to resubmit portfolios, and who 
fai led the portfol ioduri ngtheyears i n which they have been high-stakes. 
Resubmission is not so much a reflection of potential as a statement of 
current professional preparedness. We teach pre-service teachers that 
students are individual learners and so are they. "Not yet" is not 
necessarily a fai lure statement. 

Assessment 

The first portfolio rubric used in Fall 1998 included the I NTASC 
principles and Division themes as criteria. The four-point scale ranged 
from (1) little progress, few expectations met, I ittledocu mentation, to (4) 
exemplary progress, all expectations met, outstanding documentation. 
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Table2 

Summary of passi ng, resubmitted, and fai I i ng portfol ios. 


Pre-Student Teaching Portfolios 



Elementary 

Secondary 


Submitted 

Passed 

Failed 

Resubmitted 

Submitted 

Passed 

Failed 

Resubmitted 

00-01 

15 

15 

100% 

0 

00% 

4 

8 

7 

87.5% 

1 

12.5% 

2 

01-02 

27 

24 

88.9% 

3 

11.1% 

8 

10 

8 

80% 

2 

20% 

9 

02-03 

22 

20 

90.9% 

2 

9% 

5 

12 

11 

91.6% 

1 

8.3% 

2 

03-04 

30 

29 

96.7% 

1 

3.3% 

6 

7 

7 

100% 

0 

0% 

2 


Graduation Portfolios 



Elementary 

Secondary 


Submitted 

Passed 

Failed 

Resubmitted 

Submitted 

Passed 

Failed 

Resubmitted 

00-01 

28 

27 

1 

8 

10 

10 

0 

3 



96.4% 

3.6% 



100% 

0% 


01-02 

18 

17 

1 

5 

4 

4 

0 

2 



94.4% 

5.5 °A 



100% 

0% 


02-03 

17 

17 

0 

6 

8 

8 

0 

1 



100% 

0% 



100% 

0% 


03-04 

30 

30 

0 

12 

7 

7 

0 

1 



100% 

0% 



100% 

0% 



F or the pre-student teachi ng portfol i o, a score of 3 was the best possi bl e 
on Section I. Our rationale is that someone who has not completed 
student teaching should not be expected to achieve exemplary progress 
on these standards. 

Even beforethefi rst portfol ios weresubmitted, thePortfol iocommit- 
teerealizedthatthisrubricwasinadequate. Hence, Section II was added 
to exami ne portfol i o desi gn . C r i ter i a a re measu red on a fou r-poi nt scale, 
however, in section 1 1 there is a specific criterion for each category. From 
this rubric, weareabletoascertain individual pre-serviceteacher growth 
as well as identify areas of programmatic concern. 

Following the pi lot and based on inter-rater agreement at that time, 
facultydeterminedthatevaluatingthepre-studentteachingportfolioon 
ascaleof Pass, H igh Pass, or Not Pass was fairer to students. This made 
the process less competitive and provided more rater reliability. The 
scale for graduation portfolios remained constant as they are held to a 
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Figure2. 

Rubricfor assessing graduation portfolios. 

Candidate Date 

Semester: □ Fall □ Spring Year Certification Area 

Eval uators 


Section I: Integration of Division Themes and INTASC Principles 

The following descriptors apply to the number on the scale 
4 - Exemplary progress, outstanding documentation 
3 - Consistent progress, adequate documentation 
2 - Some progress, some documentation 
1 - Inadequate progress, little documentation 


Division Theme 

Score 

Comments 

Reflective Scholars actively contemplate that what 
they teach is of value and that their approach is effective. 



Instructional Leaders work to develop curriculum that 
promotes active engagement in developmentally 
appropriate learning. 



Global Citizeis seek to shape the world of the twenty-first 
century through their roles in the classroom and beyond. 



INTASC Principle 

Score 

Comments 

1. The pre-service teacher understands the central 
concepts, tools of inquiry, and structures of the disdplinefs) 
he or she teaches and can create learning experiences that 
make these aspects of subject matter meaningful for students. 



2. The pre-service teacher understands how children learn 
and develop, and can provide learning opportunities that 
support their intellectual, social and personal development. 



3. The pre-service teacher understands how pupils differ 
in their approaches to learning and creates instructional 
opportunities that are adapted to diverse learners. 



4. The pre-service teacher understands and uses a variety 
of instructional strategies to encourage students' development 
of critical thinking, problem solving, and performance skills. 



5. The pre-service teacher uses an understanding of individual 
and group motivation and behavior to create a learning 
environment that encourages positive social interaction, 
active engagement in learning, and self-motivation. 



6. The pre-service teacher uses knowledge of effective 
verbal, nonverbal, and media communication techniques 
to foster active inquiry, collaboration, and supportive 
interaction in the classroom. 



7. The pre-service teacher plans instruction based upon 
knowledge of subject matter, students, the community, 
and curriculum goals. 
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Figure2. Rubricfor assessing graduation portfolios, (continued) 


INTASC Principle 

Score 

Comments 

8. The pre-service teacher understands and uses formal 
and informal assessment strategies to evaluate and 
ensure the continuous intellectual, social and physical 
development of the learner. 



9. The pre-service teacher is a reflective practitioner who 
continually evaluates the effects of his/her choices and 
actions on others (students, parents, and other 
professionals in the learning community) and who actively 
seeks out opportunities to grow professionally. 



10. The pre-service teacher fosters relationships with 
school colleagues, parents, and agencies in the larger 
community to support students' learning and well being. 




Section I Subscore DA score of 1 in any category initiates the resubmission process. 


Section II: Portfolio 


Criteria 

Score 

Comments 

1 ntroduction: 

4=Significant, dear information about purpose & organization 
3=Adequate information about purpose & organization 
2=Some information about purpose & organization with 
elements lacking clarity and/or completeness 
1=1 nsufficient information about purpose & organization 



Organization: 

4=Evidence is logically presented in a way that is clearly 
"reader friendly" 

3=Evidence is logically presented clearly and consistently 
2=Some organization with some lack of clarity or consistency 
1=1 nsufficient organization that confuses reader 



Documentation of Achievement: 

4=Well-chosen, significant documentation 
3=Adequate documentation demonstrating appropriate selelion 
2=Some documentation with some problems of 
superficiality or appropriateness 
1=1 nsufficient or inappropriate documentation or too much 
documentation without evidence of selection 



Variety among Documentation: 
4=Evidence of high versatility 
3=Evidence of expanding versatility 
2=Moderate versatility demonstrated 
1=1 nsufficient versatility demonstrated 



Explanations Accompanying Artifacts: 
4=Relationship to Division's themes 

& INTASC principles is clearly articulated 
3=Clearly articulated explanations with most 
information relating relevance 
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Figure2. Rubricfor assessing graduation portfolios, (continued) 

Criteria Score Comments 

2=Somewhat clear explanations with some 
information relating relevance 
l=Explanations lack clarity with little or no 
information relating to principles or themes 

Reflective Entries: 

4=5ignificant insight & critical thinking demonstrated 
3=Some evidence of insight & critical thinking 
2=Superficial evidence of insight and/or critical thinking 
l=Lacks evidence of insight and/or critical thinking 

Appearance: 

4=Creative appearance that piques reader's interest 
3=Neat, professional appearance 
2=5omewhat professional in appearance 
l=Messy, unprofessional appearance 

Writing Mechanics: 

4=Word Usage & mechanics captivate reader 
3=Few errors in grammar, spelling, word usage, 
or punctuation 

2=Si gnifi cant grammar, spelling, word usage, 
or punctuation errors 

l=Substantial grammar, spelling, word usage, 
or punctuation distracts reader 

Section II Subscore □ A score of 1 in any category initiates the resubmission 

process. 


higher expectation and would use their portfolio for a competitive job 
search. 

To ensure inter-rater agreement we developed a faculty workshop 
and a process for ongoing review of inter-rater reliability. Prior to the 
workshop each faculty member read a portfol iothat was rated asthe best 
portfolio, i.e., the standard. All subsequent portfolios would be judged 
against that standard. Then each faculty member individually scored a 
portfol i o of I esser qualityandsharedthe scor i n g. D i scussi on of h ow a n d 
why items were scored as they were helped achieve consensus on the 
standard by which a portfolio would be scored. 

Each portfolio is evaluated by varying teams of two faculty, one of 
whom is a member of the Assessment Committee. Since each Assess- 
ment Commi ttee member wor ks wi t h f acu I ty members who h ave worked 
on other teams, a high rate of agreement is confirmed. To maintain 
reliability and to introduce new faculty to the process, we regularly 
review portfolio standards and provide training. Review teams may 
request that a second team score a portfol io. I n every case where a team 
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has requested a second team review of a portfol io, the second team score 
was within two points of the original score. 

I n order to evaluate program effectiveness, we developed a database 
that systemati cal I y assesses portfol i o data and provi des aggregate i nfor- 
mation of pre-service teachers' performance. The aggregate data pro- 
vides evidence of program quality and identifies areas of concern. We 
compare pre-service teacher scores on each measure to identify areas 
that might indicatea program weakness. I nsights from data analysisare 
i nval uablefor determi ni ng program i mprovement. F or example, i n early 
portfolios it was evident that pre-service teachers were unable to 
document teacher as global citizen, which is part of our conceptual 
framework. As we examined our program, it became cl ear that we were 
not emphasizing this theme to the extent necessary for pre-service 
teachers. H ence, changes and addi ti ons have been made i n many cou rses 
and across the entire program. For example, a service-learning project 
was added to a course providing pre-service teachers the opportunity to 
work and learn with diverse groups. 

Policies 

Every portfolio policy developed has a supporting story. Policies are 
reviewed every semester and revised as needed. Development of policies 
camefrom experience, and student andfaculty concerns. I n every instance, 
we st rive to create a process with integrity sothat pre-serviceteachersare 
fai rly and consistently eval uated regardi ng thei r preparation for teachi ng 
while ensuring the quality of public school teachers. For example, one 
pol i cy i s rel ated to the date and ti me for submi ssion of portfol i os. E arl y i n 
the pilot, a few pre-service teachers submitted their portfolios after the 
time deadline. To be fair to everyone, we developed a policy that if a 
portfolio is not submitted by the set day and time for submission, when 
submitted it is considered a resubmission. Therefore, that pre-service 
teacher would only have one opportunity for the portfolio to pass. 

A key portfolio policy isthat pre-service teachers have one opportu- 
nityto resubmit a revised portfolio. The resubmission isonlyevaluated 
intheareasthatdidnot pass and by theteam of reviewersthat eval uated 
the original portfolio. If this resubmission fails there is a third review 
process by another team of evaluators. 

Forthosewhofail thethird review, a remedial plan and/or an appeals 
process is i mplemented based on the reasons for fai I ure. One pre-service 
teacher might repeat the Capstone course, including a limited field 
experi ence and su bmi t a new portfol i o. Others mi ght be requ i red to take 
a writing course, register for another field experience, or even be 
encouraged into another field. All policies are included in the Portfolio 
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Guidelines, which areregularly updated and accessibleon our website. 

Lessons Learned 

During the time we implemented the portfolio process, we learned 
many valuable lessons. Here is a summary: 

♦ Portfolios need to be more than a collection of course docu- 
ments; they need to provide opportunity for creativity, personal 
reflection and professional growth. 

♦ Preparation for developing a portfolio must be integrated into 
the program. 

♦ The process of reflection must be taught at increasingly 
complex levels. 

♦ F acu I ty n eed to revi ew portfol i ogu i del i nes and to revi ew i nter- 
rater reliability issues each semester because of the time lapse 
between portfolio reviews. 

Benefits of Portfolios 

Our experience with portfolios has furthered our understanding of 
implementation, assessment, and of the value of portfolios and of our 
students' needs. A pre-service teacher leaves our program well prepared 
and with a portfol iothat includes a professional development plan. Each 
semester pre-serviceteachers express how difficult it wastopreparethe 
portfol i o, yet they are j ustifi abl y proud and have a feel i ng of accompl i sh- 
ment when it is completed as noted anecdotally by their comments. 
Furthermore,thegraduation portfolio brings cl osuretothe undergradu- 
ate experience while providing strong evidence for entry into the 
teaching profession. More recently, our graduates havecommented that 
our portfolio process better prepared them for the induction portfolio 
required by I ndiana as part of attaining their professional license. 

Local school districts have identified how well our pre-service 
teachers are prepared for interviews and for teaching in their districts. 
The value of a pre-service teacher's development asa reflective scholar 
through the portfolio process cannot be underestimated. Successful 
teachers are those who can critically reflect on their practice for 
continuous improvement and being abletodothis as a beginning teacher 
will make a difference for the children they teach (Lyons, 1998). 

Pre-service teachers' ability to be reflective has improved as the 
process has evolved. Wenow see prof essional-looking portfolios containing 
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well-chosen artifacts that effectively demonstrate the self-concept and 
strengths of the pre-student teacher. Explanations connect artifacts to 
I NTASC principles and themes and reflectionsthat go beyond "thelesson 
went well." Figure 3 provides examples of an artifact "explanation" and 
"ref I ecti on , " t he f i rst from a portfol i o su bmi tted 2001 and the other from a 
2004 portfol i o. These exampl es evi dence the i ncr eased depth of refl ecti ve 
practice after reflection was i ntegrated throughout the program. 

The faculty in our Division of Education identified several ways in 
which the portfolio has benefited our entireteacher education program: 

♦ Team-work among faculty in resolving philosophical and 
student issues. 

♦ Innovation in teaching as we integrated performance- based 
assessment. 

♦ I n depth discussion with peers about teach i ngduri ng portfol i o 
review. 

♦ A quality data base that is used as one means of program 
assessment and improvement. 

♦ Continuous engagement in understanding and critiquing 
conceptual framework integration throughout our program. 

Critical Issues 

Along with the valuable outcomes from implementing the portfolio 
process, unresolved issues remain. For faculty, the issue of workload is a 
problem. All Division of Education faculty evaluate from six to ten 
portfol i os each semester, resubmissions, and if needed athi rd review. E ach 
portfol io requi res a mi ni mum of two hours to eval uate. This occurs at the 
end of the semester when faculty are involved in assessing and grading 
their courses. Faculty in other divisions do not have such expectations on 
their time, making this an inequitable workload. The only solution 
identified thus far isto indicate involvement with portfolio review under 
the teaching component of our annual reviews. This is a step, albeit 
i nsuff i ci ent , to recogn i zi ng t he r i gors of portfol i o revi ew. D i vi si on f acu I ty 
recognize the benefits of portfolios to our pre-service teachers and our 
program and have accepted the responsi bi I ity for this assessment. 

Another important issue is that a portfolio is "high stakes" for pre- 
serviceteachers. Although webui It i n a resubmission opportunity and an 
appeal process, each semester since implementation we have had pre- 
service teachers fai I the portfol io. The enormity of the task of prepari ng 
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Figure3. 

E xamplesof artifact expl anation and reflecti on demonstrati ng i ncr eased 
depth of reflective practice. 


Student Explanation and Reflection 2001 

Student Explanation and Reflection— 2004 

ExplanationAfter completing a chap- 
ter from the math textbook 1 gave stu- 
dents the standardized test as an assess- 
ment. After grading the exams, 1 created 
a graph to show the number of times 
each problem was missed. From this 1 
was able to see that there were two 
problems missed 44% of the time. Each 
problem covered a different concept. As 
a result of the data 1 determined that to 
ensure the students mastery of these 
concepts re-teaching would be neces- 
sary. This process served as an assess- 
ment of my own instruction and led me 
to reflect on my instructional approaches 
to these concepts (INTASC #8, Reflec- 
tive Scholar). 1 realized that the method 
of instruction for these concepts pro- 
vided by the textbook was too abstract 
for some students (INTASC #2). 1 then 
developed a week-long math lesson fo- 
cused on theseconcepts. 1 used my knowl- 
edge of the theory of multiple intelli- 
gences to guide instructional choices to 
ensure that the needs of the diverse 
learners in my classroom would be met 
(INTASC #3, Instructional Leader). 

ExplanationThis lesson was a re-teach- 
ing of haiku poems. Thefirst lesson, taught 
the previous day, was not effective and 1 
did not feel that students were grasping 
the ability to write haiku poems. It was 
evident by their comments and short, 
choppy poems that students didn't under- 
stand the process (8). Students were fa- 
miliar with haiku and understood its lay- 
out after the lesson, but were having a 
hard time writing haiku poems. In this 
lesson, 1 broke the process down into 
more basic steps. This lesson started the 
writing process in a completely different 
manner, which was what 1 thought stu- 
dents had the most trouble with in the 
previous lesson. This time 1 had students 
start by writing one sentence about the 
assigned topic. Then, they added, changed 
or deleted words based on the syllable 
count to get 17 syllables. Last, they broke 
the poem down into three lines with five, 
seven and five syllables. When 1 taught 
this lesson thefirst time, 1 emphasized the 
three lines and students were writing 
three short sentences for their haiku 
poems. This time, 1 emphasized that it is 
one sentence divided into three lines. By 
writing the sentence first, 1 hoped toelimi- 
nate that problem. Also, 1 demonstrated 
the inability to breaka poem down intothe 
three lines because of the way thesyllables 
were divided between words. Doing this 
showed students what to do to solve this 
problem if they encountered it (6). 

ReflectionBy completing this process 1 
have learned a great deal about the 
importance ofassessing myself as an 
educator. Student teaching has helped 
me realize thatmath instruction is an 
area in which 1 would like to continue to 
grow. Throughthese activities 1 have 
increased my knowledge of mathemati- 
cal strategies and learned it is important 
for me to take the extra ti me to perform 

Reflectionwriting haiku poems went 
much better this time around. Approach- 
ing haiku poetry from the perspective of 
one sentence worked for these students 
(4). Their poems flowed better and it 
seemed like they had an easier time draft- 
ing a haiku. 1 nsteadof three small, choppy 
sentences that repeat the noun, students 
were writing longer, complex sentences 
to tell about their subject. Also, this lesson 


Issues in Teacher Education 


Cheryl Stolle, Betty Goerss, & Marilyn Watkins 


41 


Figure3. 

E xamplesof artifact expl anation and reflecti on demonstrati ng i ncr eased 
depth of reflective practice, (continued from previous page) 


Student Explanation and Reflection 200] 

Student Explanation and Reflection— 2004 

assessments of my own instruction in 
this subject area to improve my teaching. 

breaks the process down into more basic 
steps, which makes the outcome attain- 
able to a diverse group of learners (3). 
Modeling the problems students could have 
encountered was good, too. This is some- 
thing that 1 need to do more of when 1 give 
students assignments. However, knowl- 
edge of those problems will come with 
more teaching experience. 1 need to fore- 
cast anticipated problems in my lessons to 
model ways students can handle them 
when they arise (6). Students worked more 
independently, only asking me for help 
replacing words to get the right number of 
syllables in a line. During writing time 
today, 1 did not hear complaints and some 
students wrote two haiku poems. Seeing 
the students’ change in attitude toward 
haiku poetry and their improved poems 
definitely made this lesson worth re-teach- 
ing (RS). 


a portfol i o and i ts i mportance has been consi stentl y rel ated to pre-servi ce 
teachers, yet some do not receive the message. To this point, we have 
worked closely with those who have fai led to hel p them become success- 
ful, often within education and sometimes outside of education. One 
purpose of performance-based assessment is to support us in making 
difficult decisions and knowing when to deny continuation. Part of our 
professional responsibility is toensurethat teachers who graduate from 
our program arecapableof being effective teachers. 

Multiple opport u n i t i es for pre-servi ce teachers to demonst rate pro- 
ficiency are incorporated intocoursework. We encourage them to use a 
variety of assessment tools in their classrooms, while considering the 
diversity of learning styles of their students. Therefore, it is critical that 
we model this when assessing their preparation for teaching. We 
recognize that for some pre-service teachers the portfolio does not 
adequatel y express thei r ski I Is as a teacher. This real i ty is one aspect of 
our ongoing effort to improve the process of assessing our pre-service 
teachers. The portfol io is just one piece of multi pie assessments in place 
for evaluating pre-service teachers. 

We must also recognize the i mportance of protecti ngtheself-esteem 
of those who do not do well on the portfolio. A portfolio is a personal 
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document and, quite appropriately, pre-service teachers take criticism 
very personally. Through workshops and discussion, faculty have been 
encouraged to make positive comments and constructive criticism that 
encourage student growth and reflection. The process is daunting and 
exacts an emotional toll on both faculty and pre-service teachers. 
Nevertheless, it is imperative that pre-service teachers are able to 
respond appropr i atel y to object i ve cri ti ci sm. 

Conclusion 

We haveestabl i shed a comprehensi ve pi an for usi ng portfol i os as one 
component of a performance- based programthat is accountablefor pre- 
service teacher learning beyond traditional means of assessment. The 
resulting portfolio is a personal document in which creativity and 
innovation demonstrate professional teaching characteristics and style 
that capitalize on pre-service teachers' potential. The final product 
prepares teachers for continued documentation of their progress toward 
meeting local, state and national standards. More importantly, it helps 
prepare teachers for the reflection and analysis necessary for profes- 
sional development and provides a systematic method for on-going 
improvement of our teacher education program. 

Whilethe portfolio policies are well established, there is a significant 
need for revisi on of the process itself. Currently faculty are reflecti ng on 
the process and we arediscussing ways in which wecan continue to reap 
the benefits while making the process more humane. Doing so is a 
commitment and focus. 
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